Visual prosody of newsreaders: Effects of information structure, emotional content and intended audience on facial expressions
نویسندگان
چکیده
This article investigates whether newsreaders exploit their expressive style for signalling different types of communicatively relevant information. The study reported upon here investigates whether these speakers use their facial expressions to ‘‘package’’ the content of their messages so that they reflect the relative importance, the emotional connotation and the intended audience of the news items. To this end, Dutch newsreaders (addressing audiences consisting of either adults or children) were analysed in terms of their facial expressions. The first study explores whether eyebrow movements and head nods of newsreaders (only adult news) are correlated with the relative prominence of words in their messages. Consistent with findings in the literature for other styles of speech, it was found that pitchaccented words in the newsreader data tended to be marked by variations in eyebrow movements and head nods. The second study aimed to find out whether newsreaders adapt their facial expressions to the seriousness of the topic they are talking about, and, if so, whether this adaptation differs for newsreaders addressing adults or children. Analyses reveal that both the topic and the intended audience had an effect of the newsreaders’ expressions, especially as the positive topics and the childdirected news items tended to be more expressive. The relevance of the findings of studies 1 and 2 for speech production and recognition is discussed. & 2009 Elsevier Ltd. All rights reserved.
منابع مشابه
Seeing Emotion with Your Ears: Emotional Prosody Implicitly Guides Visual Attention to Faces
Interpersonal communication involves the processing of multimodal emotional cues, particularly facial expressions (visual modality) and emotional speech prosody (auditory modality) which can interact during information processing. Here, we investigated whether the implicit processing of emotional prosody systematically influences gaze behavior to facial expressions of emotion. We analyzed the e...
متن کاملEmotion in the voice influences the way we scan emotional faces
Previous eye-tracking studies have found that listening to emotionally-inflected utterances guides visual behavior towards an emotionally congruent face (e.g., Rigoulot and Pell, 2012). Here, we investigated in more detail whether emotional speech prosody influences how participants scan and fixate specific features of an emotional face that is congruent or incongruent with the prosody. Twenty-...
متن کاملImpact of voice on emotional judgment of faces: an event-related fMRI study.
Emotional information can be conveyed by various means of communication, such as propositional content, speech intonation, facial expression, and gestures. Prior studies have demonstrated that inputs from one modality can alter perception in another modality. To evaluate the impact of emotional intonation on ratings of emotional faces, a behavioral study first was carried out. Second, functiona...
متن کاملFacial Expression Recognition Based on Anatomical Structure of Human Face
Automatic analysis of human facial expressions is one of the challenging problems in machine vision systems. It has many applications in human-computer interactions such as, social signal processing, social robots, deceit detection, interactive video and behavior monitoring. In this paper, we develop a new method for automatic facial expression recognition based on facial muscle anatomy and hum...
متن کاملVisual Prosody Analysis for Realistic Motion Synthesis of 3d Head Models
In this paper a methodology is proposed for speech driven facial animation. Specifically, the proposed technique is not intended to reproduce lips movements accordingly with the speech content, but the goal is to reproduce the complex set of facial movements and expressions related with the emotional content of the speech. An original approach has been developed to map directly, without the nee...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- J. Phonetics
دوره 38 شماره
صفحات -
تاریخ انتشار 2010